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I discuss whether the standard cosmological models fit the WMAP data well 
enough to justify parameter estimation with standard assumptions. The observed 
quadrupole is low (but has significant foreground uncertainty) and drives weak 
evidence for theoretical models predicting low values, such as models with a run- 
ning spectral index. Other more seriously outlying points of the WMAP power 
spectrum appear not to fit the expectations of simple Gaussian models very well. 
The effective temperature chi-squared is however acceptable on large scales. There 
also appears to be evidence for an anisotropic distribution of power, which taken 
together with the other points may indicate that either there is a problem with 
the WMAP data or that standard cosmological models are incorrect. These issues 
should be clarified before cosmological parameter extraction for the usual standard 
models can be trusted, and hint that maybe the CMB is more interesting than we 
imagined. I also discuss various systematic and analysis issues, and comment on 
various oddities in the publicly available first year WMAP data and code. 



1. Introduction 

The recent results of the Wilkinson Microwave Anisotropy Probe (WMAP^P pro- 
vide full-sky maps of the CMB anisotropy together with various foregrounds and 
noise. Taken at face value the anisotropy power spectrum can be used to tightly 
constrain various combinations of cosmological parameters. Partial parameter de- 
generacies can be broken by including additional data from other sources, giving 
good constraints on many parameters individually^^. However data from Lyman-a 
forest is currently plagued by systematic issues (for example see Ref. 0J, so joint 
constraints including only statistical errors should not be taken too seriously. Even 
cosmic shear results, which in principle are a clean probe of the total matter distri- 
bution and should give robust joint parameter constraint J^, are currently subject 
to various observational systematics and uncertainties than can be hard to quantify. 
Constraints on the matter power spectrum from 2dP^ are sensitive to how the bias 
is modelled, with conservative results that are marginalized over the biaJ^ giving 
significantly higher results for the matter density than when more complicated mod- 
elling is applied^. Having said this, there is a remarkable agreement between the 
cosmological parameters inferred from many of these data sets and different CMB 
power spectrum measurements, indicating that the basic flat ACDM model with 
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approximately power-law isotropic adiabatic Gaussian primordial fluctuations may 
be on the right track. 

In principle the CMB anisotropy measurement on large scales should be the 
cleanest and most direct probe of primordial physics. Usually the sky maps are com- 
pressed into power spectra for the purpose of likelihood evaluation, which should be 
nearly optimal if the fluctuations are indeed isotropic and Gaussian, and the power 
spectrum and likelihoods are evaluated consistently. Given a function for computing 
the likelihood from a theoretical power spectrum, computing the posterior param- 
eter constraints is straightforward using the publicly available CosmoMC codJSt. 
However as discussed by Ref. Eland other authors the WMAP power spectrum has 
some unexpected features, and seems to have a rather high \eg fit to standard 
models. I discuss these features in more detail below, where bulleted points are of 
a technical or trivial nature and may be skipped. 

2. Temperature power spectrum 




Figure 1. The WMAP power spectrum at low I (where it is signal dominated). The thick line 
shows a theoretical spectrum (the mean of each value over many realizations). The points are 
the WMAP Ci estimates. The other lines on the left plot are isoprobability contours enclosing 
68%, 95% and 99% for the appropriate \ 2 distribution (no noise), lines on the right plot are from 
pseudo-Cf simulations with noise, where 32%, 5% and 1% of Cg realizations are equi-distributcd 
below and above the different lines. This assumes the plotted theoretical model is correct. 

In Fig.^I have plotted the WMAP temperature Ct estimates at I < 250 where 
the uncertainty from the noise is not too large. On the full sky and with no noise the 
maximum likelihood estimators are given by Ci = Y] m |a; m | 2 /(2Z + l) where the ai m 
are the coefficients of the spherical harmonic expansion of the CMB temperature 
on the sky. With cuts around foregrounds like the galaxy and in the presence of 
noise things are not quite so simple. The values plotted are pseudo-C^ estimators, 

a http://cosmologist.info/cosmomc/ 
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which are suboptimal but simple to compute as described in Refs. El E For a 
given theoretical model the probability distribution for the Ci estimators in any 
particular realization of the sky is something like a x 2 with (21 + l)/ s 2 ky degrees of 
freedoirP (where / s k y is the fraction of sky observed). The most likely values of the 
estimators are therefore actually below the mean value (which is the variance of the 
ai rn s predicted by the theoretical model). 

The limits in Fig. ^ are approximate and depend on the theoretical model. 
However there still appear to be a number number of points significantly outside 
the 99%-confidence lines. There were only three models in 16000 simulations with 
Ci8i lower than the observed value. Outlying points also seem to come in clusters, 
with the binned power spectrum having some wigg leffl 



2.1. Goodness of fit 

The goodness of fit of the observed points to the theoretical model can be assessed by 
using some kind of effective XcS varue - Ref. 2 reports an effective Xcs — 1431 based 
on the likelihood of the theoretical best fit model given the observed Ci estimators 
(including the T-E correlation power spectum). This may be surprisingly high for 
the 1342 degrees of freedom, indicating that the standard best fit model has rather 
low probability given the data. However we note a few technical points: 

• The otherwise excellent third-order likelihood approximation used by WMAF^ 
cannot be expected to be accurate for points far from the theoretical value. The 
values of the likelihoods for the outlier points are probably underestimated and 
hence giving an artificially high Xcff ( an d could be skewing parameter estimates, 
c.f. the section on the quadrupole below.) 

• Noise contributions to the variance of the have been neglected at I < 100 even 
though the noise at I ~< 100 is about five times larger than for I ~> 100 because 
fewer frequencies are being used. This overestimates the effective Xeff by about 
16 (though has no significant effect on parameter estimates). 

The best way to asses whether an effective xis ^ s acceptable is by simulations' 3 . 
Taking the temperature data only at £ < 250 the observed XcS ^ s 275, compared to 
simulations which give 248 ± 25(l<r). Thus on these scales where the noise is small 
there is not strong evidence that anything is amiss. More detailed simulations 
would be needed on smaller scales to assess whether the xts = 963 over t < 900 
is acceptable or not. Sec also the section below on the temperature-polarization 
cross-correlation. 



b My simulations are rather crude, using single maps and modelling the noise as an isotropic 
contribution to the variance, which may give wider dispersion than a full simulation. I take the 
best-fit theoretical model as fixed. My \eff however accounts for the noise at £ < 100. 
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2.2. Low quadrupole 

The low value of the quadrupole has attracted considerable attention. Although 
the likelihood of the observed C2 is not that low for standard models (just outside 
the the 68% likelihood contour in Fig. [TJ, it is atypical in being low. This means 
that any model which predicts a low value for the quadrupole will have a higher 
posterior probability than standard models, because in the new model the low value 
can be much more typical (and so have much higher likelihood) . Some points about 
the quadrupole value: 

• The very low value reported by WMAP of G% = 123/iK 2 has unmodelled fore- 
ground uncertainties. For example treating the foregrounds differently by using 
the map from Ref. 1101 one obtains a pseudo-C^ estimate C2 = 184/^K 2 . (See also 
Ref.HTll 

• Ref. 1 101 claim that the value is low partly because of a coincidence that the galaxy 
obscures regions of high power. This appears to be a much smaller effect than 
the foreground uncertainty, as cutting the galactic region from the map used in 
that paper only lowers the C'2 by ~ 10%. 

• The exact value of the estimator and the likelihood value for different models 
is sensitive to how accurately you model the distribution. There are significant 
differences between a near-optimal analysis using orthogonalized harmonic J"^^'"' ! 
and the WMAP pseudo-C^ and likelihood parameterization. 

Without including Lyman-a data on very small scales, some weak evidence for 
running of the spectral index arises from the low value of the WMAP quadrupole^ 
favouring low theoretical quadrupole values. Other models which favour low 
quadrupoles are also favoured, though very low values cannot be obtained by only 
changing the initial power spectrum. This is because about half of the power in the 
quadrupole comes from the Integrated Sachs Wolfe (ISW) effect, which is sourced 
by changing potentials along the line of site. Though the large scale power can 
be decreased to lower the contribution to the quadrupole from last scattering, the 
ISW contribution cannot be lowered without decreasing the power on smaller scales 
which is inconsistent with the values of the other Cg. The ISW effect can be de- 
creased by changing the dark energy model from a cosmological constant^! but 
when combined with a strange initial power spectrum this is becoming a seriously 
contrived model. 



3. Temperature-polarization correlation 

The power spectrum for the correlation between the temperature and E-polarization 
appears to indicate a significant optical depth to last scattering^! The relevant 



c See the plot at http://cosmologist.info/Sorrento03. Note that problems of modelling the quadrupole 
likelihood do not appear to significantly bias parameter constraints for different initial power spectrum 
models. Even though absolute likelihood values may differ over the range of models for different 
methods, the models always predict much higher values than the observed value and the slope of the 
likelihood function is approximately correct over the relevant range. 
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Figure 2. The temperature-polarization correlation power spectrum estimators at I < 16 pro- 
vided by WMAP. Error bars are noise only, and both sets of points are available from the WMAP 
web page. 

large scale power spectrum is plotted in Fig. [21 showing the excess of power on 
large scales that is a signature of reionization. The points with the error bars are 
those plotted in Ref. El whilst the other set of points are the values actually used 
to compute the likelihoods^. Presumably these are different analyses of the data, 
and the significant difference between the points indicate a significant unaccounted 
for systematic error in the measurement of the TE power spectrum. It is inter- 
esting to note that £ — 7 is quite discrepant from theoretical expectations, but 
does not change significantly between the two analyses. The more than factor of 
two systematic difference in the TE quadrupole values likely explains the apparent 
inconsistency with the temperature quadrupole value discussed in Ref. El The 
WMAP likelihood analysis also neglects the correlation between the temperature 
and TE power spectra, though this does not have a large effect on joint-constraint 
cosmological parameter values. 6 



4. Asymmetries 

One of the main theoretical assumptions of most cosmological models is that the uni- 
verse is statistically isotropic: after removing the local dipole the CMB anisotropy 
should not have any alignment other than random variations expected from throw- 



d http://lambda.gsfc. nasa.gov/ 

including the correlation is no harder than ignoring it at Gaussian order, though it is not trivial 
to find a third-order likelihood parameterization accounting for the correlations. One can compute 
the likelihood distributio ns e ssentially exactly on large scales using orthogonalized harmonicii^l 
(or Monte-Carlo methods^!) with Gaussianity assumptions, which should probably at least be 
used as a check on any parameterization that is used when better (and more foreground-free) data 
is available. 
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ing down realizations of statistically isotropic random fields on the sky. Ref. IT%1 
find in fact that the quadrupole and octopole have some rather unlikely alignment 
properties, with the octopole being nearly planar, and the axes of the two being 
closely aligned (however a posteriori statistics for small samples of numbers should 
be interpreted with a little care). 

Interestingly Ref. 1191 report that there are also highly significant power 
anisotropies on larger scales. As an independent minor variation on this theme 
I computed a single binned Ci with I < 30 over half the sky as a function of the 
axis of the hemisphere, trying 48 different orientations. There is an apparent asym- 
metry with a hemisphere centred close to the north ecliptic pole giving about 35% 
less power than the opposite hemisphere. The significance of this result is readily 
checked by simulating skies according to the predictions of some Gaussian ACDM 
model, and computing the maximum value of the power ratio in the different re- 
alizations. The observed value lies 2 — 3 sigma away from the maximum value of 
the power ratio, indicating that such a large power deficit over the northern ecliptic 
hemisphere is rather unlikely. The axis of asymmetry can also be seen (though 
with less statistical significance) for smaller bins in £, though does not persist to 
small scales. It appears that there is a region of startlingly low large scale power 
somewhere around the north ecliptic pole. Colour figures are available on the web f . 

5. Conclusions 

It would appear that the WMAP data might be inconsistent with simple 
isotropic Gaussian cosmological models. Given the past experience (e.g. with 
BOOMERANG) one's first suspicion naturally falls on the data, and the align- 
ment of power with the ecliptic (the axis of symmetry of the observation) may be a 
hint in this direction. However the features appear to be quite robust, and deficits 
in power are quite hard to explain with foregrounds. One possible explanation for 
the outlying points in the power spectrum might be non-Gaussianity, with a; m s 
being more likely close to zero or large than if they had a Gaussian distribution. 

Whatever the resolution of the puzzle, the current determination of cosmological 
parameters assuming everything fits our assumptions is potentially misleading. A 
small number of outlier points with large weight under the Gaussianity assumption 
could be skewing parameter estimates if they are included in the analysis but in 
fact have their origin in some other systematic or non-Gaussian physics. However 
the concordance of parameter estimates does suggest that this effect may be small. 
In any case it should be a matter of some priority to check the WMAP results. 

Ref. El nas presented a very nice Monte Carlo method for computing cosmo- 
logical parameter likelihoods essentially exactly if the CMB really is Gaussian and 
isotropic. This can include foreground uncertainties consistently, and avoids all the 
problems with computing accurate likelihood values from a set of Cg estimators. 



f http: / /cosmologist.info/Sorrento03 
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